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(54) Video compression coding and decoding with automatic sub-pixel frame/field motion compensation. 

(57) An input frame to be motion compensated is 
partitioned into smaller blocks of pixel data. 
First, motion estimation is performed on each 
block in the full-pixel resolution. Then, the 
full-pixel resolution motion vector is refined to 
half-pixel accuracy by searching the surround- 
ing half-pixel resolution blocks in the vertical 
and horizontal position with respect to the 
full-pixel resolution motion vector. An absolute 
magnitude of a horizontal component of the 
full-pixel resolution motion vector is examined 
to see if it is greater or less than a predeter- 
mined threshold to detect any significant move- 
ment If the horizontal component absolute 
magnitude is less than the threshold, a frame- 
based interpolation will be used for forming the 
sub-pixel resolution block. If the horizontal 
component absolute magnitude is greater than 
the threshold, a field-based interpolation will be 
used instead. The sub-pixel resolution block is 
subjected to motion estimation and compens- 
ation to obtain a predicted block which will then 
be coded to obtain a coded bit stream. 
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BACKGROUND OF THE INVENTION, 

1. Field of the Invention 

This invention relates to compression coding and 5 
decoding of good quality interlaced scan video sig- 
nals for digital storage and transmission media. 

2. Description of the Prior Art 

10 

The bandwidth compression of video signal has 
attracted many active researches and standardization 
efforts recently. Various techniques have been ex- 
plored for the digital coding of various video signal for- 
mat at different bit rates. 15 

In terms of the techniques of obtaining the video 
sequence sources from the recording devices and lat- 
er refreshing on display devices, video sequence can 
be classified into two types: progressive scan video 
sequence and interlaced scan video sequence. In a 20 
progressive scan video sequence, a frame in the se- 
quence is captured and refreshed sequentially line by 
line from the top to bottom of the frame. In an inter- 
laced scan video sequence, a frame consists of two 
fields, the even field made up of the even lines of the 25 
frame and the odd field made up of the odd lines of 
the frame. Capturing and refreshing are performed 
first on the even field, sequentially from top to bottom 
of the field, and followed by the odd field in the same 
manner. Since a large number of the present sources 30 
are in the interlaced scan format (e. g. NTSC, PAL), 
increasing number of researches had been directed 
towards the efficient coding of the interlaced scan 
video sequence. 

Video bandwidth compression is done by reduc- 35 
ing the temporal, spatial and statistical redundancy in 
a video sequence. To reduce the temporal redundan- 
cy, motion estimation and compensation is used. Ac- 
cording to the prior art in motion estimation and com- 
pensation (e. g. the MPEG Video Simulation Model 40 
Three, International Organization for Standardization, 
Coded Representation of Picture and Audio Informa- 
tion, 1990, ISO-IEC/JTC1/SC2/WG8 MPEG 90/041), 
the frames, which can also be referred to as pictures, 
in an interlaced scan video sequence can be classi- 45 
fied into two types: (1) intra-coded frames in which 
each frame is coded using information only from itself; 
(2) predictive-coded frames in which each frame is 
coded using motion compensated prediction from a 
past intra-coded or predictive-coded frame or/and a so 
future intra-coded or predictive-coded frame. 

Each frame in the sequence is first partitioned 
into blocks of pixel data which are then processed by 
a block coding method such as discrete cosine trans- 
form (DCT) with or without motion compensation. For 55 
predictive-coded frame, the blocks are coded with 
motion compensation using information from an adja- 
cent frame by block matching motion estimation and 



compensation to predict the contents of the coded - 
frame. The block matching algorithm used consists of 
determining the direction of translatory motion of the 
blocks of pixels from one frame to the next by finding - 
the best matching block based on some pre-deter- 
mined criteria. The differences between the best 
matching block and the actual block of pixels are then 
subjected to transformation (e. g. DCT) and quantiza- 
tion based on a quantization matrix and quantization 
steps given by a rate-controller, and run-length en- 
coding of the quantized DCT coefficients. Fig. 1 is a 
block diagram describing the method proposed by 
MPEG. Detailed description of the method can be 
found in the document "MPEG Video Simulation Mod- 
el Three (SM3) tt , ISO-IEC/JTC1/SC2/WG8, MPEG 
90/041, 1990. 

In order that the decoder can use the best match- 
ing block for performing motion compensation, each 
block of pixels has an associated motion vector to in- 
dicate the location of the best matching block in the 
adjacent frame. The motion vector is a pair of num- 
bers indicating the x and y offset of the block's loca- 
tion in the adjacent frame, with reference to the cur- 
rent block's location. For example, a motion vector of 
(3, 2) means that the best match for the current block 
can be found in the adjacent frames at the location +3 
pixel to the right and +2 pixel below the current 
block's location. If all the motion vectors used for mo- 
tion compensation are integer values, the motion vec- 
. tors are called full-pixel resolution motion vectors, and 
the searching process for these full-pixel resolution 
motion vectors is called full-pixel search, in order to 
obtain a more accurate block from the adjacent frame 
for compensation, a sub-pixel resolution motion vec- 
tor may be obtained. The sub-pixel resolution motion 
vector has non-integer values and points to a location 
in between the full-pixel location. The block to be 
used for compensation is then interpolated by using 
the pixels around it. One common example of the sub- 
pixel resolution motion vector is the half-pixel resolu- 
tion motion vector. The half- pixel resolution motion 
vector may have values +/-0.5, +/-1 .5, +/-2.5, .... 
The search for the half-pixel resolution motion vector 
usually follows afterthe full-pixel search such that the 
half-pixel is searched around the location indicated by 
the full-pixel resolution motion vector. The half-pixel 
resolution motion vector indicates that the best 
matching block of the adjacent frame comes from a 
half-pixel resolution block. This half-pixel resolution 
block can be obtained from the adjacent frame in two 
different ways, considering the interlace structure of 
the sequence, resulting in a frame-based interpola- 
tion mode and a field-based interpolation mode. 

Fig. 2a illustrates the method of obtaining the 
half-pixel resolution motion vector in the frame-based 
interpolation mode. In Fig. 2a, P0 to P8 are pixels of 
the adjacent frame in thefull-pixel positions, i. e., they 
are the original non-interlaced pixels. In the frame- 
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"based interpolation mode, these pixels are treated 
without taking into account of which field they come 
from. P0 is assumed to be the location pointed to by 
the full-pixel resolution motion vector, and H1 to H8 
the top left corners of the half- pixel resolution blocks. 
One of these will give the best matching half-pixel re- 
solution block. The best matching half-pixel resolution 
block is then compared with the block obtained using 
the full-pixel resolution motion vector (i. e., block with 
top left corner at P0), and the one that gives the best 
performance will be chosen as the block for motion 
compensation. As shown in Fig. 2a, depending on 
their locations, the interlaced pixels are obtained by 
taking the average of the two adjacent pixels or the 
average of the four adjacent pixels. To form a half- 
pixel resolution block of size 8x8, 8 rows and 8 col- 
umns of the pixels need to be interpolated. 

Fig. 2b shows the field-based interpolation mode. 
In Fig. 2b, E0 to E8 are pixels of the adjacent frame 
coming from the odd field. If the full-pixel resolution 
motion vector points to the even field, for example E0, 
the half-pixel resolution motion vector will be obtained 
from one of the positions HE1 to HE8. Similarly to the 
frame- based interpolation mode, HE1 to HE8 are also 
the top left corners of the half-pixel resolution blocks. 
Each half-pixel resolution block is formed with refer- 
ence to the field pixel positions by taking the average 
of the two or four pixel values from the same field. 
The best matching half-pixel resolution block is then 
compared with the block obtained using the full-pixel 
resolution motion vector (i. e., block with top left cor- 
ner at E0), and the one that gives the best perfor- 
mance will be chosen as the block for motion compen- 
sation. The same procedure is applied if the full-pixel 
resolution motion vector points to the odd field, 00. 

Due to time difference between the two fields of 
the frame, motion of the objects in an interlaced se- 
quence will cause the objects to be displaced from 
one field to the other. In such case, the field-based 
interpolation mode will give a better motion estimation 
with half pixel accuracy compared with the frame- 
based interpolation mode. 

In order to determine the best half- pixel resolu- 
tion motion vector for the coded block in the motion 
estimation process, both the frame-based and field- 
based interpolations need to be performed to obtain 
all half-pixel resolution blocks, and followed by a com- 
parison based on some pre-defined criteria, such as 
mean absolute error, to determine which mode and 
which half-pixel position would give a minimum error 
for the coded block. With this method, the information 
of which of the frame interpolation mode and the field 
interpolation mode is being selected, has to be transmit- 
ted to the decoder. An example of the implementation of 
the above method is described in the document "Pro- 
posal Package," ISO-IEC/JTC1/SC29/WG11, MPEG, 
91/228,1991. 

The above-described method of adaptive 



frame/f ield interpolation for sub-pixel motion estima- 
tion has several problems, in order to- obtain the sub- 
pixel resolution motion vector, sub-pixel resolution 
blocks of frame-based interpolation and also field- 

5 based interpolation need to be obtained for compari- 
son and this is costly in hardware implementation. 
Secondly, to use this method, extra information (bit) 
needs to be transmitted to the decoder for each coded 
block so that the decoder uses the corresponding 

10 correct frame or field interpolation mode for sub-pixel 
motion compensation. With frame/field sub-pixel re- 
solution block comparison using mean absolute error 
criteria, a visually smooth sub-pixel motion estimation 
was found difficult in some cases. 

15 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide a 
video compression coding/decoding method which 
20 provides an effect of better reconstructed picture 
quality. 

Another object of the present invention is to pro- 
vide a video compression coding/decoding method 
efficiently performing motion estimation and com- 
25 pensation. 

Still another object of the present invention is to 
provide an automatic adaptation of field-based and 
frame-based methods to different regions in an input 
frame. 

30 A further object of the present invention is to pro- 

vide a video compression coding/decoding method in 
which no extra information needs to be transmitted 
from an encoder to a decoder and hence a reduction 
of bit-rate can be achieved. 

35 A still further object of the present invention is to 

provide a video compression coding/decoding meth- 
od in which computation time for the search of the 
half- pixel resolution motion vector can be reduced. 
Yet another object of the present invention is to 

40 provide a video compression coding/decoding meth- 
od which provides a better prediction for the block to 
be coded. 

To achieve the above objects, a method accord- 
ing to the present invention automatically selects the 
45 frame-based orf ield-based mode to form the sub-pix- 
el resolution block for motion estimation and compen- 
sation. This method is based on the fact that station- 
ary regions in a frame have high spatial correlation 
between adjacent lines and that regions correspond- 
50 ing to the moving objects have higher correlation 
within each field compared to that of the adjacent 
lines. In this method, an input frame to be motion 
compensated is partitioned into smaller blocks of pix- 
el data. As a first step, motion estimation is performed 
55 on each block in the full-pixel resolution using a ref- 
erence frame. In a second step, the detected full-pixel 
resolution motion vector is then refined to half-pixel 
accuracy by further searching the surrounding half- 
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pixel resolution blocks in the vertical and horizontal 
position with respect to the full-pixel resolution motion 
vector using the reference frame. In this step, abso- 
lute magnitude of a horizontal component of the full- 
pixel resolution motion vector is examined to see if it 5 
is greater or less than a predetermined threshold to 
detect any significant movement. If the horizontal 
component absolute magnitude is less than the 
threshold, frame-based interpolation mode will be 
used for forming the sub-pixel resolution block. 10 
Whereas if the horizontal component absolute mag- 
nitude is greater than the threshold, the field-based 
interpolation mode will be used instead. 

In this way, instead of forming both the frame- 
based and field-based interpolation mode sub-pixel 15 
blocks, only one of them may be formed. As the mo- 
tion vector is examined to select either the frame- 
based interpolation or the field-based interpolation, 
no extra bit need to be transmitted to the decoder for 
the decoder to decide which of the frame-based or 20 
field-based interpolation modes should be used to ob- 
tain a predicted block for compensation. 

With the above-mentioned methods, blocks with 
high motion, detected by the magnitude of the hori- 
zontal component of its motion vector, will be estimat- 25 
ed and then compensated using the field-based 
method of forming the half-pixel resolution blocks. 
Blocks with little motion will be estimated and then 
compensated using the frame-based method of form- 
ing the half-pixel resolution blocks. The difference be- 30 
tween the block to be coded and the predicted block 
is then processed using the conventional block cod- 
ing techniques such as the DCT followed by quanti- 
zation and run-length and variable length coding. 

By the above automatic adaptation of field-based 35 
orframe-based method to different regions in an input 
frame, two advantages can be realized. First, no extra 
information needs to be transmitted to the decoder 
and hence a reduction of bit-rate can be achieved. 
Second, computation time for the search of the half- 40 
pixel resolution motion vector can be reduced since 
either the frame-based or field-based interpolation 
may be computed, not both. The sub-pixel resolution 
block is also better represented compared to the 
method which uses solely the frame-based interpola- 45 
tion or solely the field-based interpolation and hence 
proyides a better prediction for the block to be coded. 

In general, the level of correlation within each 
picture frame in a video sequence differs between a 
stationary scene and a turbulent scene. Therefore, so 
the present invention provides a method of more ef- 
ficiently adapted to these two different scenes during 
the motion estimation and compensation process. In 
a fixed bit-rate video coding system, the present in- 
vention provides an effect of better reconstructed pic- 55 
ture quality. 



BRIEF DESCRIPTIONS OF THE DRAWINGS 

Fig. 1 is a block diagram illustrating the SM3 cod- 
ing algorithm which is the prior art of the present in- 
vention. 

Fig. 2a is an illustration of frame-based half-pixel 
interpolation. 

Fig. 2b is an illustration of field-based half-pixel 
interpolation. 

Fig. 3 is a block diagram of an encoder with au- 
tomatic sub-pixel frame/field motion compensation 
method which is a preferred embodiment of the pres- 
ent invention. 

Fig. 4 is a block diagram of a decoder embodying 
the present invention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Fig. 3 shows a block diagram of an encoder as a 
preferred embodiment of the present invention. An in- 
put interlaced video signal 17 contains pixel data of 
two fields for each picture. The two field data are 
merged in a field merger 1 to form pixel data of a 
frame. The frame data are stored in a current frame 
memory 1 . The frame data stored in the current frame 
memory 1 are then passed through a line 59 to a ref- 
erence frame memory 10 to be stored therein. The 
frame data stored in the reference frame memory 10 
will be used as reference data in the later described 
motion estimation process. There are two modes of 
processing data of a frame: an intra- coded mode in 
which each frame is coded using information only 
from itself; and a predictive-coded mode in which 
each frame is coded using motion compensation pre- 
diction from a past intra-coded or predictive-coded 
frame or/and a future intra-coded or predictive-coded 
frame. Most of the frames will be coded using the pre- 
dictive-coded mode to reduce the temporal redun- 
dancy. Intra-coded frames are used periodically in the 
video sequence to support some other functions of 
video play like fast forward, fast reverse, random ac- 
cess and to give error robustness. The decision 
whether a frame is to be intra-coded or predictive- 
coded is made according to the number (or position) 
of the frame in the sequence of the video signal. The 
number (or position) of the frame to be intra-coded is 
predetermined. For example, if it has been predeter- 
mined to have one intra-coded frame for every fifteen 
frames, (n+1)th frames (where n=0, 1,2,.. .), i.e., 
first, 16th, 32nd, . . . frames will be intra-coded and 
the rest will be predictive-coded. 

A block sampling circuit 2 receives the data stor- 
ed in the current frame memory 1 through a line 27 
and partitions the frame data into spatially non-over- 
lapping blocks of pixel data. To provide a reasonable 
level of adaptiveness, a block size of 8x8 pixels may 
be used. The frame number of the frame is also stored 
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in the current frame memory 1 and passed through 
the block sampling circuit 2 to a switch (S1 ) 58. Based 
on the frame number, the switch 58 selectively deliv- 
ers the output blocks of pixel data from the block sam- 
pling circuit 2 to a line 19 for a process in the intra -cod- 5 
ed mode or to a line 20 for a process in the predictive- 
coded mode. 

For the intra-coded mode, the output of the block 
sampling circuit 2 is passed through the line 19 to a 
discrete cosine transform (DCT) circuit 6. The DCT 10 
circuit 6 performs discrete cosine transform, which is 
a popular mathematical transformation for converting 
image data to data in the frequency domain. The 
transformed data, i.e., DCT coefficients, are then 
subjected to the process of quantization in a quanti- 15 
zation circuit 7 using a quantizer matrix and a quan- 
tizer step size which is given by a rate controller 9 
through a line 22. The quantized data are passed, to- 
gether with the quantizer step as side information, 
through a line 33 to a run-length coding & variable 20 
length coding circuit 8. The run-length coding & vari- 
able length coding circuit 8 performs run-length cod- 
ing of the quantized data and the associated side in- 
formation followed by variable length coding of the 
run-length coded result. The output of the run-length 25 
coding & variable length coding circuit 8 is a coded bit 
stream 29 ready to be transmitted to the decoder. This 
bit stream is also passed through a line 23 to the rate 
controller 9. Based on the number of bits already used 
at the time of encoding the block, the rate controller 30 
9 adjusts the quantizer step so that the output bit 
stream 29 satisfies the bit rate requirement of the en- 
coder system. The quantized values obtained by the 
quantization circuit 7 are passed also through a line 
24 to an inverse quantization circuit 1 6 and an inverse 35 
discrete cosine transform (inverse DCT) circuit 15. 
The inverse quantization circuit 16 performs the re- 
verse process of quantization performed by the quan- 
tization circuit 7, and the inverse DCT circuit 15 per- 
forms the reverse process of the discrete cosine 40 
transform performed by the DCT circuit 6 to obtain re- 
constructed data. The reconstructed data is stored in 
a local decoded frame memory 14 through a line 30, 
and will be used for motion compensation process of 
the next input frame. 45 

For the predictive-coded mode, the output of the 
block sampling circuit 2 is passed through the line 20 
to a full-pixel motion vector (MV) estimation circuit 3. 
In the full-pixel MV estimation circuit 3, motion vector 
estimation in the full-pixel resolution is performed to so 
determine full- pixel resolution motion vectors from 
the original adjacent frame using reference frame 
data stored in the reference frame memory 10 ob- 
tained through a line 27. The full-pixel MV estimation 
circuit 3 finds the closest match by, for example, de- 55 
termining the direction of translatory motion of the 
blocks of pixels from one frame to the next by finding 
the best matching block based on some predeter- 



mined criteria, such as mean square error. The full- 
pixel MV estimation circuit 3 outputs the obtained full- 
pixel resolution motion vectors together with the 
blocks of pixels to be coded which have been supplied 
from the block sampling circuit 2 through the line 20. 

After the full-pixel resolution motion vectors are 
obtained, half-pixel resolution motion vectors will be 
obtained in an interpolation unit 21. Each full-pixel re- 
solution motion vector outputted from the full-pixel 
MV estimation circuit 3 is passed through a line 31 to 
a horizontal motion detection circuit 11 . The horizontal 
motion detection circuit 11 examines to see if the ab- 
solute value of the horizontal component of the full- 
pixel resolution motion vector (horizontal motion vec- 
tor) is greater or less than a pre-defined threshold to 
detect any significant movement. A horizontal motion 
vector having an absolute value greater than the pre- 
defined threshold means a significant movement for 
the block of data. The result of this is used to control 
a switch (S2) 25 to select a frame-based interpolation 
or a field-based interpolation. If the absolute value 
(magnitude) of the horizontal motion vector is less 
than the pre-defined threshold, the switch 25 selects 
a frame-based interpolation circuit 12 which performs 
the frame-based interpolation to form a half-pixel re- 
solution block. Whereas if the absolute value of the 
horizontal motion vector is greater than the pre-de- 
fined threshold, the switch 25 selects a field-based 
interpolation circuit 13 which performs the field- 
based interpolation to form a half-pixel resolution 
block. The reference block data used for the interpo- 
lation in each of the interpolation circuits 12 and 13 is 
obtained from the reference frame memory 10 
through a line 26. 

A half-pixel motion vector (MV) estimation circuit 
4 receives the half-pixel resolution blocks outputted 
from the frame-based interpolation circuit 12 or the 
field-based interpolation circuit 13 and the full-pixel 
resolution motion vectors and the blocks to be coded 
which are outputted from the full-pixel MV estimation 
circuit 3. The half-pixel MV estimation circuit 4 per- 
forms motion vector estimation in the half-pixel reso- 
lution by using the full-pixel resolution motion vectors 
and the half-pixel resolution blocks to determine half- 
pixel resolution motion vectors. Half-pixel resolution 
motion vectors surrounding a full-pixel resolution mo- 
tion vector are examined to see which one can give 
the best match to a block to be coded. For example, 
if a full-pixel resolution motion vector is (3, 5), half- 
pixel resolution motion vectors surrounding this full- 
pixel resolution motion vector, i.e., (2.5, 5), (3.5, 5), 
(2.5. 4.5), (3, 4.5), (3.5, 4.5), (2.5, 5.5), (3, 5.5) and 
(3.5, 5.5), are examined to see which one can give the 
best match to a block to be coded. If the best match 
of a half-pixel resolution motion vector is better than 
that given by the full-pixel resolution motion vector, 
the half-pixel resolution motion vector is outputted 
from the half-pixel MV estimation circuit 4 together 
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with the block to be coded. Otherwise, the full-pixel 
resolution motion vector is outputted from the half- 
pixel MV estimation circuit 4 together with the block 
to be coded. 

The motion vectors (full-pixel or half-pixel resolu- s 
tion motion vectors) obtained in the motion vector es- 
timation process are passed, together with the blocks 
to be coded, through a line 56 to a motion compensa- 
tion circuit 5 which performs motion compensation 
using the blocks stored in the local decoded frame 10 
memory 14 as reference blocks. If the motion vector 
is the half- pixel resolution motion vector, frame- based 
or field-based interpolation process is performed de- 
pending on whether or not the absolute magnitude of 
the horizontal component of the half-pixel resolution 15 
motion vector is greater than a pre-defined threshold, 
similarly to the process in the interpolation unit 21 , by 
using the reference block read from the local decoded 
frame memory 14 to obtain a predicted block. If the 
motion vector is the full-pixel resolution motion vector, 20 
no interpolation is needed and the reference block 
read from the local decoded frame memory 14 is used 
as a predicted block. Differences between values of 
the pixels of the block to be coded and values of the 
pixels of the predicted block are computed to obtain 25 
a differential block composed of the difference val- 
ues. Based on the differential block, the motion com- 
pensation circuit 5 also determines whether the block 
to be coded should be motion compensated or not by 
comparing the activity of the block to be coded and 30 
the differential block using some pre-defined criteria, 
such as standard deviation of the blocks. If the block 
to be coded is decided to be motion compensated, its 
differential block is passed through a line 32 to the 
DCT circuit 6. If the block to be coded is decided not 35 
to be motion compensated, the block itself (i.e., the 
original block outputted from the block sampling cir- 
cuit 2) is passed through the line 32 to the DCT circuit 
6 (which is the same as the block of the intra-coded 
frame). Further, the motion compensation circuit 5 40 
produces an information bit indicating whether a 
block is coded with motion compensation or not, and 
passes the information bit together with the motion 
vector to the DCT circuit 6. That is, the data outputted 
from the motion compensation circuit 5 through the 45 
line 32 to the DCT circuit 6 are either the differential 
block (coded with motion compensation) or the origi- 
nal block (coded without motion compensation), the 
information bit r-dicating whether or not the block is 
coded with motion compensation, and either the full- so 
pixel resolution motion vector or the half-pixel resolu- 
tion motion vector. 

The block data from the motion compensation cir- 
cuit 5 are transformed to DCT coefficients in the DCT 
circuit 6, and the DCT coefficients are quantized in 55 
the quantization circuit 7 to be quantized DCT coeffi- 
cients. The information bits each indicating whether 
or not a block is coded with motion compensation and 



the motion vectors are passed through the DCT cir- " 
cuit 6 and the quantization circuit 7 to the line 33. The 
quantized data (quantized DCT coefficients), togeth- 
er with side information including the quantization 
step, the motion vectors and the information bits each 
indicating whether or not motion compensation is 
done to a block, are passed through the line 33 to the 
run-length coding & variable length coding circuit 8 to 
be subjected to run-length coding and variable length 
coding to become the output coded bit stream 29. The 
bit stream is also passed through the line 23 to the 
rate controller 9. The quantized data from the quanti- 
zation circuit 7 is also passed through the line 24 to 
be subjected to inverse quantization in the inverse 
quantization circuit 16, inverse DCT in the inverse 
DCT circuit 15 and stored in the local decoded frame 
memory 14 for the encoding of the next frame. 

A video signal decoding apparatus embodying 
the present invention is shown in Fig. 4. 

In this embodiment, input coded information 34, 
which is the encoded video bit stream transmitted 
from the encoder, is inputted to a variable length de- 
coding & run-length decoding circuit 35 which demul- 
tiplexes and decodes the variable length codes to 
produce the quantized coefficients of each block of 
the coded frame and the side information of the 
block, i. e. t the motion vector, quantization step and 
the information bit indicating whetherthe block is mo- 
tion compensated or not. The variable length decod- 
ing & run-length decoding circuit 35 also checks the 
frame number of the frame to be decoded to see 
whether the frame is intra-coded or predictive-coded. 
The decoded quantized coefficient block is passed 
through a line 53 to an inverse quantization circuit 36 
to be subjected to an inverse quantization process 
and then to an inverse discrete cosine transform (in- 
verse DCT) circuit 37 to be subjected to an inverse 
discrete cosine transformation (inverse DCT) proc- 
ess. The output of the inverse DCT circuit, which is a 
sequence of blocks of pixel data, is passed through a 
line 55 to a switch (S1) 54. Also, the side information 
obtained in the variable length decoding & run-length 
decoding circuit 35 is passed through the line 53, the 
inverse quantization circuit 36, the inverse DCT cir- 
cuit 37 and the line 55 to the switch 54. 

The switch 54 checks the frame number and, if 
the frame to be decoded is an intra-coded frame, 
sends the output of the inverse DCT circuit 37 directly 
to a decoded frame memory 48 through a line 46. The 
data stored in the decoded frame memory 48 is then 
outputted as an output reconstructed sequence 51 
through an output line 63. The output reconstructed 
sequence is sent also to a local decoded frame mem- 
ory 40 through a line 50 for motion compensation of 
the next frame. 

If the frame to be decoded is a predictive-coded 
frame, the switch 54 checks the information bit indi- 
cating whether a block is coded with motion compen- 
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'sation or not and, if the block outputted from the in- 
verse DCT circuit 37 is coded without motion compen- 
sation, sends the block directly to the decoded frame 
memory 48. The data stored in the decoded frame 
memory 48 is then outputted as an output recon- 
structed sequence 51 through the output line 63, and 
is sent also to the local decoded frame memory 40 
through the line 50 for motion compensation of the 
next frame. 

If the block outputted from the inverse DCT circuit 
37 is coded with motion compensation, it is the differ- 
ential block and a predicted block has to be obtained 
through a frame or field interpolation process per- 
formed in an interpolation unit 41 and a motion com- 
pensation performed in a motion compensation cir- 
cuit 38. In this case, the switch 54 sends the output 
of the inverse DCT circuit 37 to the motion compen- 
sation circuit 38. On the other hand, the motion vector 
obtained in the variable length decoding & run-length 
decoding circuit 35 is sent through a line 45 to a hor- 
izontal motion detection circuit 39 in the interpolation 
unit 41 . The horizontal motion detection circuit 39 ex- 
amines the magnitude of the horizontal vector to see 
whether it is greater or less than the pre-defined 
threshold. According to the examination result, the 
horizontal motion detection circuit 39 controls a switch 
43 to select a frame interpolation process or a field in- 
terpolation process. If the magnitude of the horizontal 
motion vector is greater than the pre-defined thresh- 
old, the switch 43 sends the data stored in the local 
decoded frame memory 40 to a frame interpolation 
circuit 42. Otherwise, the switch 43 sends the data 
stored in the local decoded frame memory 40 to a 
field interpolation circuit 44. The frame interpolation 
circuit 42 performs frame interpolation process using 
the data from the local decoded frame memory 40 to 
obtain the predicted block. The field interpolation cir- 
cuit 44 performs field interpolation process using the 
data from the local decoded frame memory 40, to ob- 
tain the predicted block. The motion compensation 
circuit 38 adds the difference block to the predicted 
block outputted from the interpolation circuit 42 or 44 
to produce a reconstructed block. This reconstructed 
block is passed through a line 49 to the decoded 
frame memory 40. The reconstructed blocks of the 
frame stored in the decoded frame memory are out- 
putted as the output reconstructed sequence 51 and 
also sent to the local decoded frame memory 40 for 
motion compensation of the next frame. 



Claims 

1 . A method of coding an interlaced scan digital vid- 
eo signal comprising of the steps of: 

partitioning each frame of an input inter- 
laced scan digital video signal into blocks of pixel 
data; 



determining whether each frame is to be 
intra-coded or predictive-coded; 

producing a full-pixel resolution motion 
vector of each block of a frame which has been 
5 determined to be predictive-coded with reference 

to a reference frame; 

checking the full-pixel resolution motion 
vector to determine whether the block is to be 
compensated using a frame-based interpolation 
10 process or a field-based interpolation process; 

subjecting the block, if the block has been 
determined to be compensated using the frame- 
based interpolation process, to the frame-based 
interpolation process or, if the block has been de- 
15 termined to be compensated using the field- 

based interpolation process, to the field-based 
interpolation process to obtain a sub-pixel reso- 
lution block; 

subjecting said sub-pixel resolution block 
20 to motion estimation and compensation to obtain 

a predicted block; and 

coding each block of a frame which has 
been determined to be intra-coded and said pre- 
dicted block to obtain a coded bit stream. 

25 

2. A method according to claim 1 , wherein said full- 
pixel resolution motion vector checking step 
checks a magnitude of a horizontal component of 
said full- pixel resolution motion vector, and deter- 
so mines that said block is to be compensated using 

the frame-based interpolation process if said 
magnitude is less than a predetermined thresh- 
old and that said block is to be compensated us- 
ing the field- based interpolation process if said 
35 magnitude is greater than said predetermined 

threshold. 

3. A method according to claim 1 or 2, wherein said 
coding step comprises the steps of: 

40 discrete cosine transforming each block 

into discrete cosine transform coefficients; 

quantizing said coefficients to obtain 
quantized coefficients; 

run-length coding said quantized coeffi- 
45 cients to obtain run-length coded data; and 

variable length coding said run-length 
coded data to obtain said coded bit stream. 

4. A method of decoding a coded bit stream which 
so has been obtained by compression coding an in- 
terlaced scan digital video signal, comprising the 
steps of; 

decoding the coded bit stream to repro- 
duce a block of pixel data and a motion vector; 
55 checking said motion vector, if said block 

is a differential block, to decide whether said 
block is to be compensated using a frame-based 
interpolation or a field-based interpolation; 
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subjecting said block, if said block has 
been decided to be compensated using a frame- 
based interpolation, to a frame-based interpola- 
tion process and, if said block has been decided 
to be compensated using a field-based interpola- 5 
tion, to a field-based interpolation process to re- 
produce a predicted block; and 

adding said differential block to said pre- 
dicted block to obtain a motion compensated re- 
constructed block that is a block of pixels of said 10 
digital video signal. 

A method according to claim 4, wherein said mo- 
tion vector checking step checks a magnitude of 
a horizontal component of said motion vector, and is 
determines that said block is to be compensated 
using a frame-based interpolation if said magni- 
tude is less than a predetermined threshold and 
thatsaid block is to be compensated using a field- 
based interpolation if said magnitude is greater 20 
than said predetermined threshold. 

A method according to claim 4 or 5, wherein said 
decoding step comprises the steps of: 

subjecting said coded bit stream to van- 25 
able length decoding and run-length decoding to 
reproduce quantized discrete cosine transform 
coefficients; 

inverse quantizing said coefficients to re- 
produce discrete cosine transform coefficients; 30 
and 

inverse discrete cosine transforming said 
discrete cosine transform coefficients to obtain 
said block of pixel data. 

35 



40 



45 



50 



55 
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legend; 

PO to P8 : pixel value in full pixel position 
HI to H8 : pixel value in half pixel position 

Frame-based interpol ation fo mwlae: 

HI - (PO + PI + P2 + P4) /4 

H2 = (P0 + P2)/2 

H3 = (PO + P2 + P3 + P5) / 4 

H4 = (P0 + P4)/2 

H5 = (PO + P5) / 2 

H6 = (PO + P4 + P6 + P7) / 4 

H7 = (PO + P7) / 2 

H8 = (PO + P5 + P7 + P8) / 4 



Figtfie 2a Frame-based half-pixel interpolation PRIOR ART 
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EO to E8 : pixel value in full pixel position (from even field) 
OO to 08 : pixel value in full pixel position (from odd field) 
HE1 to HE8 : pixel value in half pixel position (for even field) 
HOI to H08 : pixel value in half pixel position (for odd field) 



Field-based interpolation formulae: 

HE1 - (EO + El + E2 + E4) / 4 

HE2 = (EO + E2) / 2 

HE3 = (EO + E2 + E3 + E5) / 4 

HE4 = (EO + E4) / 2 

HE5 - (EO + E5) / 2 

HE6 = (EO + E4 + E6 + E7) / 4 

HE7 = (E0 + E7)/2 

HE8 = (EO + E5 + E7 + E8) / 4 



HOI = (OO + Ol + 02 + 04) / 4 

HO2=(O0 + O2)/2 

H03 - (OO + 02 + 03 + 05) / 4 

H04 = (OO + 04) / 2 

H05 = (O0 + O5)/2 

H06 = (OO + 04 + 06 + 07) / 4 

H07 - (OO + 07) / 2 

H08 = (OO + 05 + 07 + 08) / 4 



Figure 2b Field-based h alf-pixel interpolation PRIOR APT 
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